Information processing apparatus, information processing method, and recording medium

ABSTRACT

Provided is a mechanism that enables the balance between the satisfaction of measurement accuracy required for an application and the suppression of power consumption. An information processing apparatus includes a control unit that acquires information indicating required accuracy of measurement information based on a result of detection by a sensor from the application that uses the measurement information, and controls the sensor on the basis of the information indicating the required accuracy.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a U.S. National Phase of International PatentApplication No. PCT/JP2017/046625 filed on Dec. 26, 2017, which claimspriority benefit of Japanese Patent Application No. JP 2017-060966 filedin the Japan Patent Office on Mar. 27, 2017. Each of theabove-referenced applications is hereby incorporated herein by referencein its entirety.

TECHNICAL FIELD

The present disclosure relates to an information processing apparatus,an information processing method, and a recording medium.

BACKGROUND ART

In recent years, there have been variously used technologies with acamera, a microphone, a global positioning system (GPS), and a varietyof sensors such as an inertial sensor. For example, self-positionestimation and orientation estimation with sensor fusion have beendeveloped for devices with less power constraints, such as airplanes andvehicles. In recent years, however, such self-position estimation andorientation estimation, however, have begun to be used for wearableterminals such as head mounted displays (HMD) and wristband-typeterminals. For such wearable terminals, there has been expecteddevelopment of a technology for suppressing power consumption withefficient use of various mounted sensors, due to size constraint for amountable battery.

As an example, Patent Document 1 below discloses a technology in whichin self-position estimation with a plurality of cameras, a camera to beused is restricted in accordance with the feature amount of a capturedimage and reception results of GPS signals, thereby enablingself-position estimation with less power consumption.

CITATION LIST Patent Document

Patent Document 1: Japanese Patent Application Laid-Open No. 2016-197083

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

However, for measurement technologies for self-position estimation,orientation estimation, and the like described in Patent Document 1above, there is no consideration about the degree of accuracy of theresult of measurement required by an application that uses a result ofmeasurement. Therefore, there is a case where a result of measurementwith too high accuracy is provided to some applications, and in such acase, it can be said that power consumption can be further suppressed.On the other hand, there is also a case of provision of a result ofmeasurement with too low accuracy to some applications, and in such acase, decrease in performance may occur in exchange for suppression ofpower consumption.

Therefore, it is desirable to provide a mechanism that enables thebalance between the satisfaction of measurement accuracy required by anapplication and the suppression of power consumption.

Solutions to Problems

According to the present disclosure, there is provided an informationprocessing apparatus including a control unit configured to acquireinformation indicating required accuracy of measurement informationbased on a result of detection by a sensor from an application that usesthe measurement information, and control the sensor on the basis of theinformation indicating the required accuracy.

Furthermore, according to the present disclosure, there is provided aninformation processing apparatus including a control unit configured toperform processing with measurement information based on a result ofdetection by a sensor, and generate information indicating requiredaccuracy of the measurement information in accordance with details ofthe processing.

Furthermore, according to the present disclosure, there is provided aninformation processing method performed by a processor, including:acquiring information indicating required accuracy of measurementinformation based on a result of detection by a sensor from anapplication that uses the measurement information; and controlling thesensor on the basis of the information indicating the required accuracy.

Furthermore, according to the present disclosure, there is provided aninformation processing method performed by a processor, including:performing processing with measurement information based on a result ofdetection by a sensor; and generating information indicating requiredaccuracy of the measurement information in accordance with details ofthe processing.

Furthermore, according to the present disclosure, there is provided arecording medium including a program recorded, the program causing acomputer to function as a control unit configured to acquire informationindicating required accuracy of measurement information based on aresult of detection by a sensor from an application that uses themeasurement information, and control the sensor on the basis of theinformation indicating the required accuracy.

Furthermore, according to the present disclosure, there is provided arecording medium including a program recorded, the program causing acomputer to function as a control unit configured to perform processingwith measurement information based on a result of detection by a sensor,and generate information indicating required accuracy of the measurementinformation in accordance with details of the processing.

According to the present disclosure, the information processingapparatus controls the sensor in accordance with the accuracy requiredby the application. This arrangement makes it possible to suppress powerconsumption, with the measurement accuracy required by the applicationsatisfied.

Effects of the Invention

As described above, according to the present disclosure, there isprovided a mechanism that enables the balance between the satisfactionof measurement accuracy required by an application and the suppressionof power consumption. Note that the above effect is not necessarilyrestrictive; and in addition to or instead of the above effect, therecan also be exhibited any of effects indicated in the presentspecification or another effect that can be grasped from the presentspecification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an illustration of an exemplary exterior appearanceconfiguration of an information processing apparatus according to anembodiment of the present disclosure.

FIG. 2 is a block diagram of an exemplary internal configuration of anHMD according to the embodiment.

FIG. 3 is an illustration of an exemplary screen displayed by the HMDaccording to the embodiment.

FIG. 4 is an illustration of an exemplary screen displayed by the HMDaccording to the embodiment.

FIG. 5 is an illustration of an exemplary screen displayed by the HMDaccording to the embodiment.

FIG. 6 is an illustration of an exemplary screen displayed by the HMDaccording to the embodiment.

FIG. 7 is an illustration for describing the overview of a firstembodiment.

FIG. 8 is a block diagram of an exemplary internal configuration of anHMD according to the embodiment.

FIG. 9 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD according to the embodiment.

FIG. 10 is an illustration for describing the overview of a secondembodiment.

FIG. 11 is a block diagram of an exemplary internal configuration of anHMD according to the embodiment.

FIG. 12 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD according to the embodiment.

FIG. 13 is an illustration for describing the overview of a thirdembodiment.

FIG. 14 is a block diagram of an exemplary internal configuration of anHMD according to the embodiment.

FIG. 15 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD according to the embodiment.

FIG. 16 is a block diagram of an exemplary hardware configuration of aninformation processing apparatus according to the present embodiment.

MODE FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present disclosure will be described indetail below with reference to the accompanying drawings. Note that, inthe present specification and the drawings, the same reference signs aregiven to constituent elements having substantially the same functionalconfigurations, and redundant description will be omitted.

Note that the description will be given in the following order.

1. Basic Configuration

2. First Embodiment

2.1. Overview

2.2. Technical Features

3. Second Embodiment

3.1. Overview

3.2. Technical Features

4. Third Embodiment

4.1. Overview

4.2. Technical Features

5. Supplement

6. Exemplary Hardware Configuration

7. Conclusion

1. Basic Configuration

First, with reference to FIGS. 1 to 5, the basic configuration of aninformation processing apparatus according to an embodiment of thepresent disclosure will be described.

(1) Exemplary Exterior Appearance Configuration

FIG. 1 is an illustration of an exemplary exterior appearanceconfiguration of the information processing apparatus according to theembodiment of the present disclosure. An information processingapparatus 100 illustrated in FIG. 1 is also referred to as an HMD.

The information processing apparatus 100 has, for example, a wearingunit of a frame structure that makes a half turn through the templeregions and back of the head, and as illustrated in FIG. 1, theinformation processing apparatus 100 is hanged on the auditory capsulesto be worn by the user. Then, the information processing apparatus 100has a display unit 121 disposed immediately in front of the user's eyes,with the information processing apparatus 100 worn as illustrated inFIG. 1. The display unit 121 includes, for example, a liquid crystalpanel, and the information processing apparatus 100 controls thetransmittance of the liquid crystal panel to allow the liquid crystalpanel to be in a through state, that is, in a transparent or translucentstate, or in a non-transmissive state.

Moreover, the display unit 121, still in the through state, displays animage such as text or a drawing, thereby allowing augmented reality (AR)information (i.e., annotation) to be superimposed and displayed onscenery in real space. Furthermore, the display unit 121, in thenon-transmissive state, is capable of displaying a captured image of thereal space captured by an outward camera 112, and superimposing anddisplaying an annotation on the captured image of the real space.

On the other hand, the display unit 121, in the non-transmissive state,is capable of displaying virtual reality (VR) information. For example,in the non-transmissive state, the display unit 121 is also capable ofreproducing and displaying content received by the informationprocessing apparatus 100 from an external apparatus or content stored ina storage medium of the information processing apparatus 100, and alsocapable of superimposing and displaying an annotation on the reproducedand displayed content. Note that the external apparatus is, for example,a server, a digital camera, a digital video camera, or an informationprocessing apparatus such as a mobile phone terminal, a smartphone, or apersonal computer (PC).

Note that hereinafter, the entirety of an image to be displayed on thedisplay unit 121 is also referred to as a screen. Here, the screen isdefined as a concept including an image to be displayed in anon-transmissive state, and a spectacle to be transparently displayedand an annotation to be superimposed and displayed thereon in a throughstate. Furthermore, each of elements included in the screen is alsoreferred to as a virtual object, and the virtual object is defined as aconcept including, for example, an annotation.

Furthermore, the information processing apparatus 100 has a pair ofinward cameras 111 facing the user disposed such that the user iscaptured from a short distance, with the information processingapparatus 100 worn by the user. Each of the inward cameras 111 functionsas a first image sensor that captures an eye of the user. The inwardcamera 111 may be a stereo camera that is also capable of acquiringdepth information, or may be provided with a depth sensor.

Furthermore, the information processing apparatus 100 has the outwardcamera 112 disposed forward, in order to capture, as a capturingdirection, a direction that the user faces (e.g., a direction that theuser visually recognizes in a case where the display unit 121 is in athrough state), with the information processing apparatus 100 worn bythe user. The outward camera 112 functions as a second image sensor thatcaptures a subject to be recognized such as a hand of the user. Theoutward camera 112 may be a stereo camera capable of acquiring depthinformation, or may be provided with a depth sensor.

Furthermore, although not illustrate in FIG. 1, an earphone speaker tobe inserted into each of the user's auditory capsules may be disposed,with the information processing apparatus 100 worn by the user.Furthermore, although not illustrated in FIG. 1, a microphone forabsorbing an external sound may be disposed.

Note that the information processing apparatus 100 according to thepresent embodiment may be an HMD as illustrated in FIG. 1, or may be,for example, a simple HMD including a smartphone fixed in front of aneye of the user. In such a case, a display, an in-camera provided on thedisplay side, and an out-camera provided on the back face side of thesmartphone function as the display unit 121, the inward camera 111, andthe outward camera 112 described above, respectively.

Besides, the information processing apparatus 100 can be achieved as,for example, a smartphone, a tablet terminal, a PC, or digital signage,other than the HMD.

The exterior appearance configuration of the information processingapparatus 100 has been described above. Subsequently, an internalconfiguration of the information processing apparatus 100 will bedescribed. Hereinafter, the information processing apparatus 100 will bedescribed as being the HMD.

(2) Internal Configuration

FIG. 2 is a block diagram of an exemplary internal configuration of theHMD 100 according to the present embodiment. As illustrated in FIG. 2,the information processing apparatus 100 according to the presentembodiment includes a plurality of constituent elements classified intoa sensor, an operating system (OS), or an application. The constituentelements classified into the sensor are physical constituent elements,and the constituent elements classified into the OS or the applicationare logical constituent elements. For example, the constituent elementsclassified into the OS or the application can be included as software tobe operated by an arithmetic device such as a central processing unit(CPU) in accordance with a program stored in a storage device such as amemory.

Sensor

The HMD 100 includes a sensor group 10 including various sensors as asensor. The sensor group 10 includes an inertial sensor 11, ageomagnetic sensor 12, a global navigation satellite system (GNSS)receiver 13, and a camera 14.

The inertial sensor 11 detects angular velocity and acceleration in, forexample, three axes. The geomagnetic sensor 12 detects the magnitude anddirection of the magnetic field. The GNSS receiver 13 receives a GNSSsignal (single-frequency or dual-frequency) from a GNSS satellite. Thecamera 14 includes a lens system, a drive system that drives the lenssystem, and an image capturing element that generates an image capturingsignal from captured light obtained by the lens system, and outputs dataof a captured image converted into a digital signal. The camera 14includes the inward cameras 111 and the outward camera 112 illustratedin FIG. 1.

The sensor may be included in, for example, a wearable device separatefrom the HMD 100. That is to say, the HMD 100 can take a sensor of adifferent device as a control target.

The sensor group 10 outputs information indicating the results ofdetection by the various sensors (hereinafter, also referred to assensor information) to a measurement unit 20. The sensor information isused for measurement (or estimation) of a position or an orientation bythe measurement unit 20. The sensor group 10 may further include anysensor that detects sensor information usable for estimation of theposition or orientation For example, the sensor group 10 can have awireless communication device capable of performing communicationconforming to any wireless communication standard such as Wi-Fi(registered trademark), and, for example, can measure a position on thebasis of radio wave intensity associated with communication with anaccess point (or base station).

The sensor group 10 can include a variety of other sensors. For example,the sensor group 10 may have a wireless communication device capable ofperforming communication conforming to any wireless communicationstandard such as Bluetooth low energy (BLE (registered trademark)),Wi-Fi, or visible light communication. Furthermore, the sensor group 10may have, for example, an infrared camera, an integrated circuit (IC)gate, a millimeter wave radar, a light detection and ranging (LiDAR), arange sensor, a laser Doppler sensor, a vehicle speed pulse sensor, abiometric information sensor, or a temperature sensor.

OS

The HMD 100 includes a measurement unit 20 and a sensor control unit 30as one function of the OS.

Measurement Unit

The measurement unit 20 measures measurement information on the basis ofsensor information. The measurement information includes at least eitherposition information or orientation information. Hereinafter, theposition information and the orientation information may be collectivelyreferred to as measurement information.

As illustrated in FIG. 2, the measurement unit 20 includes a positioningunit 21 and an orientation measurement unit 22. The positioning unit 21measures the position information (i.e., performs positioning) on thebasis of sensor information output from the sensor group 10. Theposition information may be information indicating an absolute positionincluding latitude and longitude, or information indicating a relativeposition with respect to a reference object. Furthermore, the positioninformation may include altitude information. The orientationmeasurement unit 22 measures the orientation information on the basis ofthe sensor information output from the sensor group 10. The orientationinformation may be information indicating an absolute orientation withrespect to the ground, or information indicating a relative orientationwith respect to a reference object.

For example, the measurement unit 20 may measure the positioninformation on the basis of the reception result of a GNSS signal.Furthermore, the measurement unit 20 may measure the positioninformation and the orientation information on the basis of a capturedimage, with use of a technique such as simultaneous localization andmapping (SLAM), for example. Furthermore, the measurement unit 20 maymeasure the position information and the orientation information on thebasis of a direction of geomagnetism. Furthermore, the measurement unit20 may measure the position information and the orientation information,with use of a technique such as pedestrian dead-reckoning (PDR) orinertial navigation. Furthermore, the measurement unit 20 may measurethe position information or the orientation information, with acombination of a plurality of pieces of sensor information and aplurality of measurement methods.

Sensor Control Unit

The sensor control unit 30 controls the various sensors included in thesensor group 10. Specifically, the sensor control unit 30 controls thesensor group 10 group, more specifically, the various sensors includedin the sensor group 10, on the basis of information indicating arequired accuracy of the measurement information.

The sensor control unit 30 can perform various sensor control. Forexample, the sensor control unit 30 may control ON/OFF (i.e.,activation/stop) of each sensor. The sensor control unit 30 stops anunnecessary sensor, thereby enabling suppression of power consumptionfor the sensor. Furthermore, the sensor control unit 30 may control theoperation frequency of the sensor. The sensor control unit 30 increasesand decreases the operation frequency, thereby enabling the fineadjustment of the measurement accuracy and the power consumption.Furthermore, the sensor control unit 30 may control the accuracy of thesensor. The sensor control unit 30 increases and decreases the accuracyof the sensor, thereby enabling the fine adjustment of the measurementaccuracy and the power consumption. The control of accuracy of thesensor can be performed, for example, by controlling the amount of powerto be supplied to the sensor. Such details of the control such as whichsensor is operated at which frequency and with which accuracy arehereinafter also referred to as a control pattern.

The sensor control unit 30 controls the sensor group 10 such that powerconsumption is suppressed with the required accuracy of the measurementinformation satisfied, further on the basis of the characteristics ofeach sensor. The sensor control unit 30 controls the sensor group 10such that the sum total of power consumption is minimized with therequired accuracy satisfied. That is to say, the sensor control unit 30determines a control pattern with the lowest power consumption thatsatisfies the required accuracy. Examples of the characteristics of thesensor include, power consumption, contribution of orientationmeasurement accuracy, contribution of position measurement accuracy, andavailability. Table 1 indicates one example of the characteristics ofthe sensor.

TABLE 1 Characteristics of Sensors Contribution Contribution oforientation of position Power measurement measurement Sensor consumptionaccuracy accuracy Availability Inertial  1 mW High Low Available sensorGeomagnetic  1 mW Moderate Low Non- sensor available GNSS  3 mW ModerateModerate Available receiver (Single-   frequency) GNSS  6 mW High HighAvailable receiver (Dual- frequency) Camera 50 mW High High Available

Besides the example indicated in Table 1 above, the characteristics ofthe sensor can include the accuracy of the sensor. Typically, the higherthe accuracy of the sensor is, the higher the measurement accuracy bythe measurement unit 20 is. The characteristics of the sensor may bepre-stored, or updated in accordance with a situation. For example, thepower consumption of each sensor may be actually measured with a currentsensor. Furthermore, estimation for the accuracy of the sensor may bechanged in accordance with external factors such as the intensity ofmotion of the HMD 100, radio wave reception statuses, the intensity ofambient light, or the number of feature points included in a capturedimage. Furthermore, the accuracy of the sensor may be measured bycomparison with a different sensor.

Here, the information indicating the required accuracy may include atleast any of absolute position accuracy, absolute orientation accuracy,relative position accuracy, or relative orientation accuracy. Theabsolute position accuracy indicates the required accuracy of absoluteposition information. The absolute orientation accuracy indicates therequired accuracy of absolute orientation information. The relativeposition accuracy indicates the required accuracy of relative positioninformation. The relative orientation accuracy indicates the requiredaccuracy of relative orientation information. In a case where theinformation indicating the required accuracy includes the pieces of theinformation, the sensor control unit 30 controls the sensor group 10 onthe basis of the piece of the information.

For example, in a case where the absolute position accuracy is 5 m andthe absolute orientation accuracy is 1°, the sensor control unit 30activates the inertial sensor 11 and the GNSS receiver 13(dual-frequency), and stops a camera. As described above, the sensorcontrol unit 30 determines a control pattern, for example, which sensoris operated at which frequency and with which accuracy, in accordancewith the required accuracy. Moreover, the sensor control unit 30 mayadjust a control pattern in accordance with whether or not the result ofmeasurement that is actually measured satisfies the required accuracy.Such control enables the HMD 100 to suppress power consumption with therequired accuracy satisfied.

Besides, the information indicating the required accuracy can includevarious information.

For example, the information indicating the required accuracy mayinclude an index corresponding to the required accuracy. Specifically,the information indicating the required accuracy may include, forexample, an index for a high accuracy measurement mode or an index for alow accuracy measurement mode. In such a case, the sensor control unit30 controls the sensor group 10 on the basis of absolute positionaccuracy, absolute orientation accuracy, relative position accuracy, andrelative orientation accuracy corresponding to the index.

For example, the information indicating the required accuracy mayinclude information indicating availability of a sensor. In such a case,the sensor control unit 30 controls the sensor group 10 such that onlyan available sensor operates. As the availability of the sensor, it maybe considered that a camera is non-available due to difficulty incapturing a clear image at night, for example.

For example, the information indicating the required accuracy mayinclude information indicating the intensity of assumed motion. Thesensor control unit 30 controls the sensor group 10 so as to stop asensor (e.g., inertial sensor 11) having an tendency in which an erroris larger in a case where active motion is assumed and operate a sensorcapable of perform stable detecting (e.g., GNSS receiver 13). Examplesof an application for which active motion is assumed include anapplication for tennis to be described with reference to FIG. 5.

For example, the information indicating the required accuracy mayinclude information indicating an object as a reference in measurementof relative measurement information (e.g., relative position or relativeorientation). For example, the sensor control unit 30 decreases thecapturing frequency of a camera for a stationary object as the referenceobject, and increases the capturing frequency of the camera for amovable object as the reference object.

For example, the information indicating the required accuracy may beinformation indicating a control pattern, for example, which sensor isoperated at which frequency and with which accuracy. In this case, thesensor control unit 30 controls the sensor group 10 in accordance withthe information indicating the control pattern.

For example, the information indicating the required accuracy may beassociated with position information (e.g., a geographical range asdescribed later in a second embodiment). In this case, the sensorcontrol unit 30 controls the sensor group 10, on the basis of theinformation indicating the required accuracy corresponding to a positionof the sensor group 10.

Applications

The HMD 100 is capable of operating various applications 40. Theapplications 40 each perform processing with sensor information. Morespecifically, the application 40 uses position information andorientation information generated on the basis of the sensorinformation. For example, the application 40 may be an AR applicationthat superimposes and displays a virtual object (i.e., annotation) inthe real space displayed on the display unit 121, with use of theposition information and the orientation information.

Here, the required accuracy can be different for each application.Hereinafter, with reference to FIGS. 3 to 5, an example of the requiredaccuracy different for each application will be described.

FIG. 3 is an illustration of an exemplary screen displayed by the HMD100 according to the present embodiment. As illustrated in FIG. 3, on ascreen 200, an annotation 202 indicating a waiting time and anannotation 203 indicating information regarding a store are superimposedabove the heads in a line 201 in the real space. For this application,although an annotation is superimposed at a position near the HMD 100,the annotation may be superimposed at a rough position. Therefore, forexample, accuracy required by this application is 2 m in absoluteposition accuracy and 20° in absolute orientation accuracy.

FIG. 4 is an illustration of an exemplary screen displayed by the HMD100 according to the present embodiment. As illustrated in FIG. 4, on ascreen 210, an annotation 211 of a huge monster is superimposeddistantly. For this application, an annotation may be superimposed at aposition far from the HMD 100 and at a rough position, whereas it isdesirable that the orientation of the monster be accurately superimposedfor reality. Therefore, for this application, the absolute positionaccuracy is 5 m and the absolute orientation accuracy is 1°, forexample.

FIG. 5 is an illustration of an exemplary screen displayed by the HMD100 according to the present embodiment. As illustrated in FIG. 5, on ascreen 220, tennis players 221 and 222 are playing tennis in a spacewhere an annotation 223 of a virtual tennis court is superimposed. Forthis application, it is desirable that the virtual tennis court beaccurately superimposed. Therefore, for this application, the relativeposition accuracy is 10 cm, and the relative orientation accuracy is 1°,for example.

Furthermore, even for an identical application, the required accuracycan differ depending on a situation. Hereinafter, with reference to FIG.6, there will be described an exemplary required accuracy that differsdepending on a situation, for a life support application for supportingthe life of the user.

FIG. 6 is an illustration of an exemplary screen displayed by the HMD100 according to the present embodiment. As illustrated in FIG. 6, on ascreen 230, an annotation 232 indicating that a sale is in progress issuperimposed above a store 231 located distantly. In such a situation,an annotation may be superimposed at a position far from the HMD 100 andat a rough position. Thus, the required absolute position accuracy andabsolute orientation accuracy are low.

A screen 240 is displayed in a case where the user approaches the store231. In such a situation, an annotation is superimposed close to the HMD100. Thus, higher absolute position accuracy and absolute orientationaccuracy are required as compared with the case of the screen 230.

A screen 250 is displayed in a case where the user enters the store 231.There are a store worker 233 and a shelf 234 inside the store 231. Then,an annotation 235 indicating a message from the store worker 233 issuperimposed in association with the store worker 233, and annotations236 and 237 each indicating sale information regarding a productdisplayed on the shelf 234 are superimposed in association with thecorresponding product. In such a situation, it is desirable that adeviation between the superimposed position and orientation of anannotation and the position and orientation of an associated real objectbe as small as possible. Thus, high relative position accuracy andrelative orientation accuracy are required.

Besides this case, the required accuracy can change depending on variousfactors such as the necessity of occlusion processing.

Hereinafter, each embodiment of the present disclosure will be describedwith, as an example, a life support application for which the requiredaccuracy varies depending on a situation. Note that the description ofparts similar to those in the basic configuration described above willbe omitted below.

2. First Embodiment

The present embodiment is an embodiment in which sensor control isperformed on the basis of information indicating accuracy required froman application. Hereinafter, the present embodiment will be describedwith reference to FIGS. 7 to 9.

<2.1. Overview>

FIG. 7 is an illustration for describing the overview of the presentembodiment. As illustrated in FIG. 7, in a scene 300, the user wearingan HMD 100 is taking a walk outdoors. Then, the application providesroute guidance to the user. The application only needs to know theapproximate location of the user, so that an error allowable range 301is wide and the required accuracy is low. Meanwhile, in a scene 310, theuser wearing the HMD 100 is shopping indoors. Then, the applicationsupports the user in shopping by, for example, superimposing salesinformation. The application requires an accurate product location andan accurate store worker location, so that an error allowable range 311is narrow and the required accuracy is high.

Thus, the HMD 100 according to the present embodiment performs sensorcontrol in accordance with the accuracy required by such an application.For example, the HMD 100 stops a camera in the scene 300 and operatesthe camera in the scene 310.

<2.2. Technical Features>

(1) Exemplary Configuration

FIG. 8 is a block diagram of an exemplary internal configuration of theHMD 100 according to the present embodiment. As illustrated in FIG. 8,the HMD 100 according to the present embodiment has constituent elementssimilar to the constituent elements of the basic configurationillustrated in FIG. 2, and further has a notification path forinformation from an application 40 to a sensor control unit 30.

The application 40 generates information indicating the requiredaccuracy of measurement information in accordance with the details ofprocessing. For example, the application 40 may be an AR applicationthat performs processing of superimposing and displaying a virtualobject (i.e., an annotation) in the real space. In such a case, theapplication 40 generates information indicating the required accuracy,in accordance with the annotation size, the superimposition distance,the superimposition accuracy, and the necessity of occlusion processing.For example, the application 40 generates information indicating lowrequired accuracy, in a case where the annotation is large, thesuperimposition distance is long, the superimposition accuracy is low,or the occlusion processing is unnecessary. Furthermore, the application40 generates information indicating high required accuracy, in a casewhere the annotation is small, the superimposition distance is short,the superimposition accuracy is high, or the occlusion processing is tobe performed.

The application 40 notifies the sensor control unit 30 of informationindicating the required accuracy. For example, the application 40 issuesnotification on information indicating the required accuracy, at varioustimings such as activation, cancellation of sleep (e.g., switching froma different application), switching of a scene, or switching of content.Besides, the application 40 may periodically notify the sensor controlunit 30 of information indicating the required accuracy. Note that theapplication 40 may change the required accuracy in accordance withcontent.

The sensor control unit 30 acquires the information indicating therequired accuracy notified from the application 40. The sensor controlunit 30 may notify the application 40 of a request for notifying theinformation indicating the required accuracy to cause the application 40to issue notification on the information indicating the requiredaccuracy.

Then, the sensor control unit 30 controls the sensor group 10, on thebasis of the information indicating the required accuracy acquired fromthe application 40. For example, in a case where the required accuracyis high, the sensor control unit 30 additionally activates a highlyaccurate sensor or a highly power-consuming sensor, or operates thesensor with high frequency. On the other hand, in a case where therequired accuracy is low, the sensor control unit 30 stops a highlyaccurate sensor or a highly power-consuming sensor, or operates thesensor with low frequency.

(2) Flow of Processing

FIG. 9 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD 100 according to the present embodiment. Asillustrated in FIG. 9, first, the HMD 100 activates an application thatrequires position information and orientation information (step S102).Next, the activated application generates information indicatingrequired accuracy (step S104). Next, the HMD 100 activates a sensor onthe basis of the information indicating the required accuracy (stepS106). Next, the HMD 100 acquires sensor information detected by thesensor (step S108). Next, the HMD 100 performs measurement processingincluding position measurement and orientation measurement based on thesensor information (step S110). Next, the application performsprocessing based on the result of the measurement (step S112). Next, theHMD 100 determines whether or not the result of the measurementsatisfies the required accuracy (step S114). In a case where it isdetermined that the required accuracy is satisfied (step S114/YES), theHMD 100 stops or intermittently operates a redundant sensor (step S116).On the other hand, in a case where it is determined that the requiredaccuracy is not satisfied (step S114/NO), the HMD 100 additionallyactivates a sensor, or operates the sensor with high frequency (stepS118). Thereafter, the processing returns back to step S108 again.

3. Second Embodiment

The present embodiment is an embodiment with use of required accuracycorresponding to position information. Hereinafter, the presentembodiment will be described with reference to FIGS. 10 to 12.

<3.1. Overview>

FIG. 10 is an illustration for describing the overview of the presentembodiment. As illustrated in FIG. 10, in a scene 320, the user wearingan HMD 100 is taking a walk in an open park. Then, an applicationprovides route guidance to the user. The application only needs to knowthe approximate location of the user, so that an error allowable range321 is wide and the required accuracy is low. On the other hand, in ascene 330, the user wearing the HMD 100 is walking in a densely built-uparea. Then, an application provides route guidance to the user. Theapplication requires the accurate location of the user for the routeguidance in the built-up environment, so that an error allowable range322 is narrow and the required accuracy is high.

Here, in the present embodiment, the position information is associatedwith information indicating the required accuracy. For example, alow-accuracy measurement area 323 as a geographical range associatedwith information indicating low required accuracy, and a high-accuracymeasurement area 324 as a geographical range associated with informationindicating high required accuracy are set. For example, an area in whichrequired accuracy becomes low, as in the scene 320 is set as thelow-accuracy measurement area 323, and an area in which requiredaccuracy becomes high, as in the scene 330 is set as the high-accuracymeasurement area 324.

The HMD 100 measures position information with, for example, a GNSSsignal or wireless communication such as BLE or Wi-Fi, and determineswhich area the HMD 100 is located in. Then, in a case where the HMD 100determines that the HMD 100 is located in the low-accuracy measurementarea 323, the HMD 100 performs sensor control according to the lowrequired accuracy. On the other hand, in a case where the HMD 100determines that the HMD 100 is located in the high-accuracy measurementarea 324, the HMD 100 performs sensor control according to the highrequired accuracy. For example, the HMD 100 stops a camera in a casewhere the HMD 100 determines that the HMD 100 is located in thelow-accuracy measurement area 323, and operates the camera in a casewhere the HMD 100 determines that the HMD 100 is located in thehigh-accuracy measurement area 324. In this case, the high-accuracymeasurement area 324 can be regarded as a geofence for switching thecamera between ON and OFF states.

<3.2. Technical Features>

(1) Exemplary Configuration

FIG. 11 is a block diagram of an exemplary internal configuration of theHMD 100 according to the present embodiment. As illustrated in FIG. 11,the HMD 100 according to the present embodiment has constituent elementssimilar to the constituent elements of the basic configurationillustrated in FIG. 2, and further has a notification path forinformation from a measurement unit 20 to a sensor control unit 30.

The measurement unit 20 notifies the sensor control unit 30 of positioninformation. For example, the measurement unit 20 notifies the sensorcontrol unit 30 of the position information periodically ornon-periodically.

The sensor control unit 30 acquires the position information notifiedfrom the measurement unit 20. The sensor control unit 30 may notify themeasurement unit 20 of a request for notifying the position informationto cause the measurement unit 20 to issue notification on the positioninformation. Then, the sensor control unit 30 controls the sensor group10, on the basis of the position information acquired from themeasurement unit 20.

Referring to information in which the geographical range is associatedwith the information indicating the required accuracy, the sensorcontrol unit 30 controls the sensor group 10 on the basis of theinformation indicating the required accuracy corresponding to theposition information acquired from the measurement unit 20.Specifically, in a case where the measured position information isincluded in a preset geographical range, the sensor control unit 30controls a sensor on the basis of the information indicating therequired accuracy corresponding to the geographical range. For example,in a case where the position information is included in a low-accuracymeasurement area, the sensor control unit 30 performs sensor controlaccording to the low required accuracy. On the other hand, in a casewhere the position information is included in a high-accuracymeasurement area, the sensor control unit 30 performs sensor controlaccording to the high required accuracy.

The information in which the geographical range is associated with theinformation indicating the required accuracy can be stored by a storageunit that is not illustrated. Alternatively, the information in whichthe geographical range is associated with the information indicating therequired accuracy can be stored in an external apparatus such as aserver, and can be appropriately transmitted to the HMD 100.

The association between the geographical range and the informationindicating the required accuracy may be optionally made by a creator ofthe application. Furthermore, the association between the geographicalrange and the information indicating the required accuracy may be made,on the basis of the density of the peripheral buildings.

(2) Flow of Processing

FIG. 12 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD 100 according to the present embodiment. Asillustrated in FIG. 12, first, the HMD 100 activates an application thatrequires position information and orientation information (step S202).Next, the HMD 100 activates a sensor (step S204). Next, the HMD 100acquires sensor information detected by the sensor (step S206). Next,the HMD 100 performs measurement processing including positionmeasurement and orientation measurement based on the sensor information(step S208). Next, the application performs processing based on theresult of the measurement (step S210). Next, the HMD 100 determineswhether or not the current position is within a high-accuracymeasurement area (step S212). In a case where the HMD 100 determinesthat the current position is within the high-accuracy measurement area(step S212/YES), the HMD 100 additionally activates a sensor, oroperates the sensor with high frequency (step S214). On the other hand,in a case where the HMD 100 determines that the current position is outof the high-accuracy measurement area (step S212/NO), the HMD 100 stopsor intermittently operates a redundant sensor (step S216). Thereafter,the processing returns back to step S206 again.

4. Third Embodiment

The present embodiment is an embodiment in which sensor control isperformed on the basis of information indicating accuracy required froman application and measurement accuracy. Hereinafter, the presentembodiment will be described with reference to FIGS. 13 to 15.

<4.1. Overview>

FIG. 13 is an illustration for describing the overview of the presentembodiment. As illustrated in FIG. 13, the user wearing an HMD 100 istaking a walk. Then, an application provides route guidance to the user.As described in the first embodiment, the HMD 100 performs sensorcontrol in accordance with accuracy required by an application.Moreover, in the present embodiment, the HMD 100 performs sensor controlin accordance with measurement accuracy.

The HMD 100 is capable of GNSS signal reception from a GNSS satellite340 to measure position information. In a case where the receptionintensity of the GNSS signal is high, the measurement accuracy of theposition information is high, and in a case where the receptionintensity is low, the measurement accuracy of the position informationis low. For example, in a case where the reception intensity of the GNSSsignal is high, as illustrated in FIG. 13, a range 341 of positioninformation specified on the basis of the GNSS signal is narrower thanan error allowable range 342 required by the application (the narrowerthe range is, the higher the measurement accuracy is, whereas the widerthe range is, the lower the measurement accuracy is). As a result, itcan be said that there is room for reduction in power consumption.

Thus, in a case where the measurement accuracy of the positioninformation based on the GNSS signal is higher than the accuracyrequired by the application, the HMD 100 stops a redundant sensor suchas a camera or operates the sensor intermittently. On the other hand, ina case where the measurement accuracy of the position information basedon the GNSS signal is lower than the accuracy required by theapplication, the HMD 100 additionally activates a sensor such as acamera, or operates the sensor with high frequency. As described above,the HMD 100 can perform finer sensor control by taking the measurementaccuracy into account in addition to the accuracy required by theapplication.

<4.2. Technical Features>

(1) Exemplary Configuration

FIG. 14 is a block diagram of an exemplary internal configuration of theHMD 100 according to the present embodiment. As illustrated in FIG. 14,the HMD 100 according to the present embodiment has constituent elementssimilar to the constituent elements of the basic configurationillustrated in FIG. 2, and further has a notification path forinformation from an application 40 to a sensor control unit 30, and anotification path for information from a measurement unit 20 to thesensor control unit 30.

The application 40 generates information indicating required accuracyand notifies the sensor control unit 30 of the information, as describedin the first embodiment.

The measurement unit 20 notifies the sensor control unit 30 ofmeasurement information. For example, the measurement unit 20 notifiesthe sensor control unit 30 of the measurement information periodicallyor non-periodically. Moreover, the measurement unit 20 may notify thesensor control unit 30 of information indicating the accuracy of themeasurement information. Examples of the information indicating theaccuracy of the measurement information that can be considered includeinformation indicating the reception intensity of the GNSS signal andinformation indicating the intensity of motion.

The sensor control unit 30 acquires the information indicating therequired accuracy notified from the application 40. The sensor controlunit 30 may notify the application 40 of a request for notifying theinformation indicating the required accuracy to cause the application 40to issue notification on the information indicating the requiredaccuracy.

The sensor control unit 30 acquires the measurement information and theinformation indicating the accuracy notified from the measurement unit20. The sensor control unit 30 may notify the measurement unit 20 of arequest for notifying these pieces of information to cause themeasurement unit 20 to issue notification on these pieces ofinformation.

Then, the sensor control unit 30 controls the sensor group 10, on thebasis of the accuracy of the measurement information acquired from themeasurement unit 20 and the information indicating the required accuracyacquired from the application 40. Specifically, in a case where themeasurement accuracy of the measurement information is more excessive(e.g., excessively higher) than the accuracy required by theapplication, the sensor control unit 30 may stop a redundant sensor oroperate the sensor intermittently. On the other hand, in a case wherethe measurement accuracy of the position information or orientationinformation is lower than the accuracy required by the application, thesensor control unit 30 additionally activates a sensor, or operates thesensor with high frequency. This arrangement enables the HMD 100 toperform finer sensor control as compared with a case where only theinformation indicating the accuracy required from the application isused and power consumption can be thus further suppressed.

Note that a threshold may be used in order to determine whether or notthe measurement accuracy is excessive. Furthermore, the sensor controlunit 30 may perform feedback control so as to satisfy the requiredaccuracy, while switching the control pattern of a sensor.

(2) Flow of Processing

FIG. 15 is a flowchart of an exemplary flow of sensor control processingperformed by the HMD 100 according to the present embodiment. Asillustrated in FIG. 15, first, the HMD 100 activates an application thatrequires position information and orientation information (step S302).Next, the activated application generates information indicatingrequired accuracy (step S304). Next, the HMD 100 activates a sensor onthe basis of the information indicating the required accuracy (stepS306). Next, the HMD 100 acquires sensor information detected by thesensor (step S308). Next, the HMD 100 performs measurement processingincluding position measurement and orientation measurement based on thesensor information (step S310). Next, the application performsprocessing based on the result of the measurement (step S312). Next, theHMD 100 determines whether or not the result of the measurementsatisfies the required accuracy (step S314). In a case where it isdetermined that the required accuracy is satisfied (step S314/YES), theHMD 100 determines whether or not the measurement accuracy isexcessively higher than the required accuracy (step S316). In a casewhere it is determined that the measurement accuracy is excessivelyhigher (step S316/YES), the HMD 100 stops or intermittently operates aredundant sensor (step S318). Thereafter, the processing returns back tostep S308 again. On the other hand, in a case where it is determinedthat the measurement accuracy is not excessively higher (step S316/NO),the processing returns back to step S308 again. Furthermore, in a casewhere it is determined in step S314 that the required accuracy is notsatisfied (step S314/NO), the HMD 100 additionally activates a sensor,or operates the sensor with high frequency (step S320). Thereafter, theprocessing returns back to step S308 again.

5. Supplement

Sensor control methods can be considered variously, in addition to themethods described above.

The HMD 100 may discriminate between GNSS priority and camera priorityto switch a sensor to be operated, on the basis of orientationinformation. For example, the HMD 100 operates a GNSS receiver 13 in acase where an image of the sky is captured because the user is lookingup at the sky, and operates a camera 14 in a case where an image withfeature points can be captured because the user is looking at theground.

The HMD 100 discriminates between GNSS priority and camera priority toswitch a sensor to be operated, on the basis of position information.For example, the HMD 100 operates the camera 14 in a downtown andoperates the GNSS receiver 13 in a park.

The HMD 100 may switch a sensor to be operated, on the basis oforientation measurement accuracy. For example, the HMD 100 operates asensor that greatly contributes to the orientation measurement accuracyin a case where the orientation measurement accuracy is high. Examplesof such a sensor include a GNSS receiver that receives a dual-frequencyGNSS signal for obtaining inter-GNSS signal difference in time, a stereocamera for visual odometry, and a geomagnetic sensor.

The HMD 100 may switch a sensor to be operated, on the basis of positionmeasurement accuracy. For example, the HMD 100 operates a sensor thatgreatly contributes to orientation position accuracy in a case where theposition measurement accuracy is high. Examples of such a sensor includea GNSS receivers for map matching.

The HMD 100 may operate all sensors in a place where charging is easy,such as the user's home, and may stop a sensor with high powerconsumption in a place where charging is difficult, such as theoutdoors.

The HMD 100 may control a sensor on the basis of the remaining batterycapacity associated with a sensor. For example, in a case where sensorsare separately included in a plurality of devices, the HMD 100preferentially operates a sensor of a device with large remainingbattery capacity and stops a sensor of a device with small remainingbattery capacity. Furthermore, for example, in a case where the HMD 100has its own battery with small remaining capacity, the HMD 100 stops asensor of the HMD 100 itself and preferentially operates a sensor of adifferent device. In such a manner, the HMD 100 enables optimization forpower consumption across the associated device group.

The HMD 100 may stop a camera for a dark or extremely bright peripheralenvironment.

The HMD 100 may reduce the number of sensors to be operated in a casewhere the HMD 100 itself or an application is in a power saving mode.

In addition to the ON/OFF of a sensor, the HMD 100 may suppress powerconsumption by, for example, quantifying arithmetic processing withapproximate calculation.

In addition to the ON/OFF of a sensor, the HMD 100 may suppress powerconsumption by, for example, stopping correction of the result ofmeasurement through network communication.

The HMD 100 may present a power consumption list of sensors to the user,and may perform sensor control on the basis of a user input. The usermay designate, for example, the ON/OFF of a sensor, or may set theON/OFF of a sensor correlated to a place.

For a low temperature, the HMD 100 may operate a sensor with large powerconsumption to generate heat.

6. Exemplary Hardware Configuration

Finally, the hardware configuration of an information processingapparatus according to the present embodiment will be described withreference to FIG. 16. FIG. 16 is a block diagram of an exemplaryhardware configuration of the information processing apparatus accordingto the present embodiment. Note that an information processing apparatus900 illustrated in FIG. 16 can achieve, for example, the informationprocessing apparatus 100 illustrated in FIGS. 1 and 2. Informationprocessing by the information processing apparatus 100 according to thepresent embodiment is achieved by cooperation of software and hardwaredescribed below.

As illustrated in FIG. 16, the information processing apparatus 900includes a central processing unit (CPU) 901, a read only memory (ROM)902, a random access memory (RAM) 903, and a host bus 904 a.Furthermore, the information processing apparatus 900 includes a bridge904, an external bus 904 b, an interface 905, an input device 906, anoutput device 907, a storage device 908, a drive 909, a connection port911, and a communication device 913. The information processingapparatus 900 may have a processing circuit such as an electric circuit,a digital signal processor (DSP), or an application specific integratedcircuit (ASIC), instead of or in addition to the CPU 901.

The CPU 901 functions as an arithmetic processing device and a controldevice, and controls the overall operation in the information processingapparatus 900 in accordance with various programs. Furthermore, the CPU901 may be a microprocessor. The ROM 902 stores, for example, programsand arithmetic parameters to be used by the CPU 901. The RAM 903temporarily stores, for example, programs to be used for execution bythe CPU 901, and parameters that appropriately change in the execution.The CPU 901 can operate as, for example, the measurement unit 20, thesensor control unit 30, and the application 40 illustrated in FIG. 2.

The CPU 901, the ROM 902, and the RAM 903 are mutually connected througha host bus 904 a including a CPU bus and the like. The host bus 904 a isconnected to the external bus 904 b such as a peripheral componentinterconnect/interface (PCI) bus through the bridge 904. Note that thehost bus 904 a, the bridge 904, and the external bus 904 b are notnecessarily separated, and these functions may be implemented on onebus.

The input device 906 is achieved by a device such as a mouse, akeyboard, a touch panel, a button, a microphone, a switch, and a lever,with which the user inputs information, for example. Furthermore, theinput device 906 may be, for example, a remote control device usinginfrared rays or other radio waves, or may be an external connectiondevice such as a mobile phone or a personal digital assistant (PDA) inresponse to an operation of the information processing apparatus 900.Moreover, the input device 906 may generate an input signal on the basisof an input by the user with the above input device, and may include aninput control circuit or the like that outputs the input signal to theCPU 901, for example. The user of the information processing apparatus900 operates the input device 906, whereby the user can input varioustypes of data to the information processing apparatus 900 and instructthe information processing apparatus 900 of processing operations.

Besides, the input device 906 can include a device that sensesinformation regarding the user. For example, the input device 906 caninclude various sensors such as an image sensor (e.g., camera), a depthsensor (e.g., stereo camera), an accelerometer, a gyro sensor, ageomagnetic sensor, an optical sensor, a sound sensor, a range sensor,and a force sensor. Furthermore, the input device 906 may acquireinformation regarding the state of the information processing apparatus900 itself, such as the orientation and moving speed of the informationprocessing apparatus 900, and information regarding peripheralenvironment of the information processing apparatus 900, such asbrightness and noise in the periphery of the information processingapparatus 900. Furthermore, the input device 906, for example, includesa GNSS module that receives a GNSS signal from a global navigationsatellite system (GNSS) satellite (e.g., a GPS signal from a globalpositioning system (GPS) satellite) to measure positioning informationincluding the latitude, longitude, and altitude of the device.Furthermore, regarding to the position information, the input device 906may be a device that senses position by transmission and reception with,for example, Wi-Fi (registered trademark), a mobile phone, a personalhandyphone system (PHS), or a smartphone, or short distancecommunication and the like. The input device 906 can include, forexample, the inward cameras 111, the outward camera 112 illustrated inFIG. 1, and the sensor group 10 illustrated in FIG. 2.

The output device 907 may include a device that visually or aurallynotifies the user of acquired information. Examples of such a deviceinclude display devices such as a cathode ray tube (CRT) display device,a liquid crystal display device, a plasma display device, anelectroluminescent (EL) display device, a laser projector, alight-emitting diode (LED) projector, and a lamp; sound output devicessuch as a speaker, and a headphone; and a printer device. The outputdevice 907 outputs, for example, results obtained by various types ofprocessing performed by the information processing apparatus 900.Specifically, the display device visually displays the results obtainedby the various types of processing performed by the informationprocessing apparatus 900, in various formats such as text, an image, atable, and a graph. Meanwhile, the sound output device converts an audiosignal including, for example, reproduced sound data and reproducedacoustic data into an analog signal, and aurally outputs the resultantsignal. The output device 907 can include, for example, the display unit121 illustrated in FIG. 1.

The storage device 908 serves as a device that stores data, the storagedevice 908 being included, as an exemplary storage unit, in theinformation processing apparatus 900. The storage device 908 is achievedby, for example, a magnetic storage unit device such as a hard diskdrive (HDD), a semiconductor storage device, an optical storage device,or a magneto-optical storage device. The storage device 908 may includea storage medium, a recording device that records data in the storagemedium, a reading device that reads data from the storage medium, and adeletion device that deletes data recorded in the storage medium. Thestorage device 908 stores, for example, programs to be executed by theCPU 901, various types of data, and various types of data acquiredexternally.

The drive 909 serves as a reader/writer for a storage medium, and isbuilt in or externally attached to the information processing apparatus900. The drive 909 reads information recorded in a removable storagemedium such as an attached magnetic disk, optical disk, magneto-opticaldisk, or semiconductor memory, and outputs the information to the RAM903. Furthermore, the drive 909 can also write information to aremovable storage medium.

The connection port 911 serves as an interface connected to an externalapparatus, and serves as a connection port to an external apparatuscapable of transmitting data, with, for example, universal serial bus(USB).

The communication device 913 serves, for example, as a communicationinterface including, for example, a communication device for connectingto a network 920. Examples of the communication device 913 include acommunication card for wired or wireless local area network (LAN), longterm evolution (LTE), Bluetooth (registered trademark), or wireless USB(WUSB). Furthermore, the communication device 913 may be, for example, arouter for optical communication, a router for asymmetric digitalsubscriber line (ADSL), or a modem for various types of communication.The communication device 913 is capable of signal transmission andreception or the like, in conformance with a predetermined protocol suchas TCP/IP, with the Internet or a different communication device, forexample. The communication device 913 can include one of the sensorsincluded in the sensor group 10 illustrated in FIG. 2, for example.

Note that the network 920 serves as a wired or wireless transmissionchannel for information to be transmitted from a device connected to thenetwork 920. For example, the network 920 may include a public networksuch as the Internet, a telephone network, or a satellite communicationnetwork; various local area networks (LANs) including Ethernet(registered trademark); or various wide area networks (WANs).Furthermore, the network 920 may include a dedicated line network suchas an internet protocol-virtual private network (IP-VPN).

Hereinabove, the exemplary hardware configuration that can achieve thefunctions of the information processing apparatus 900 according to thepresent embodiment has been indicated. Each of the constituent elementsdescribed above may be achieved by including a general-purpose member,or may be achieved by hardware specialized for the respective functionsof the constituent elements. Thus, the hardware configuration to be usedis appropriately changeable, in accordance with a technical level atcarrying out the present embodiment.

Note that a computer program for achieving each function of theinformation processing apparatus 900 according to the present embodimentas described above can be created and implemented on a PC or the like.Furthermore, there can be provided a computer readable recording mediumthat has such a computer program stored therein. Examples of therecording medium include a magnetic disk, an optical disk, amagneto-optical disk, and a flash memory. Furthermore, the abovecomputer program may be distributed through, for example, a networkwithout using a recording medium.

7. Conclusion

Hereinabove, each of the embodiments of the present disclosure has beendescribed in detail with reference to FIGS. 1 to 16. As described above,the information processing apparatus 100 according to the embodimentsacquires information indicating the required accuracy of the measurementinformation from the application that uses the measurement informationbased on the result of detection by the sensor, and controls the sensoron the basis of the information indicating the required accuracy. Theinformation processing apparatus 100 is capable of sensor control on thebasis of the required accuracy. Thus, the information processingapparatus 100 controls the sensor to reduce power consumption for theexcessive measurement accuracy, and the information processing apparatus100 controls the sensor for the insufficient measurement accuracy,thereby making it possible to satisfy the required accuracy. As aresult, for example, regarding to an AR application operating in theHMD, the sensor with high power consumption is switched off for theallowable required accuracy, thereby making it possible to extend thecontinuous usable time.

The preferred embodiments of the present disclosure have been describedabove in detail with reference to the accompanying drawings; however,the technical scope of the present technology is not limited to theexamples. It is obvious that persons having ordinary knowledge in thetechnical field of the present disclosure can conceive variousalternation examples or modification examples within the scope of thetechnical idea described in the claims, and it is naturally understoodthat such alternation examples or modification examples belong to thetechnical scope of the present disclosure.

For example, although the examples of the cases where the positioninformation and the orientation information are measured have beendescribed in the above embodiments; however, the present technology isnot limited to the examples. For example, the present technology may beapplied to various measurement processing based on sensor information,such as image recognition processing, sound recognition processing,speed measurement processing, and environmental information measurementprocessing. The information processing apparatus 100 is capable ofsensor control in accordance with the accuracy of measurementinformation, for any measurement processing.

Furthermore, the above embodiments can be combined appropriately. Forexample, the first embodiment and the second embodiment may be combined.In this case, the information processing apparatus 100 controls asensor, on the basis of information indicating required accuracycorresponding to a geographical range in the predetermined geographicalrange, and controls the sensor outside the geographical range, on thebasis of information indicating required accuracy acquired from anapplication. Furthermore, the second embodiment and the third embodimentmay be combined. In this case, in this case, the information processingapparatus 100 controls a sensor, on the basis of information indicatingrequired accuracy corresponding to a geographical range in thepredetermined geographical range, and controls the sensor outside thegeographical range, on the basis of information indicating requiredaccuracy acquired from an application and accuracy of measurementinformation.

Furthermore, the pieces of processing described with the flowcharts inthe present specification may not necessarily be performed in theillustrated sequence. Some processing steps may be performed parallelly.Furthermore, an additional processing step may be adopted, and someprocessing steps may be omitted.

Furthermore, the effects described in the present specification aremerely explanatory or exemplary, and are not restrictive. That is, thetechnology according to the present disclosure can exhibit other effectsobvious to those skilled in the art from the description of the presentspecification, together with or instead of the above effects.

Note that, the following configurations also belong to the technicalscope of the present disclosure.

(1)

An information processing apparatus including:

a control unit configured to acquire information indicating requiredaccuracy of measurement information based on a result of detection by asensor from an application that uses the measurement information, andcontrol the sensor on the basis of the information indicating therequired accuracy.

(2)

The information processing apparatus according to (1) described above,in which the control unit controls the sensor further on the basis ofpower consumption of the sensor.

(3)

The information processing apparatus according to (2) described above,in which the control unit controls the sensor such that a sum total ofthe power consumption is minimized with the required accuracy satisfied.

(4)

The information processing apparatus according to (2) or (3) describedabove, in which the control unit controls the sensor on the basis of aremaining battery capacity associated with the sensor.

(5)

The information processing apparatus according to any one of (1) to (4)described above, in which the control unit controls at least any ofactivation/stop of the sensor, operation frequency of the sensor, oraccuracy of the sensor.

(6)

The information processing apparatus according to any one of (1) to (5)described above, in which the measurement information includes at leasteither position information or orientation information.

(7)

The information processing apparatus according to (6) described above,in which the information indicating the required accuracy includes atleast any of required accuracy of absolute position information,required accuracy of absolute orientation information, required accuracyof relative position information, or required accuracy of relativeorientation information.

(8)

The information processing apparatus according to any one of (1) to (7)described above, in which the information indicating the requiredaccuracy includes an index corresponding to the required accuracy.

(9)

The information processing apparatus according to any one of (1) to (8)described above, in which the information indicating the requiredaccuracy includes information indicating availability of the sensor.

(10)

The information processing apparatus according to any one of (1) to (9)described above, in which the information indicating the requiredaccuracy includes information indicating intensity of assumed motion.

(11)

The information processing apparatus according to any one of (1) to (10)described above, in which the information indicating the requiredaccuracy includes information indicating an object as a reference inmeasurement of the measurement information that is relative.

(12)

The information processing apparatus according to any one of (1) to (11)described above, in which in a case where measured position informationis included in a preset geographical range, the control unit controlsthe sensor on the basis of the information indicating the requiredaccuracy corresponding to the geographical range.

(13)

The information processing apparatus according to any one of (1) to (12)described above, in which the control unit controls the sensor on thebasis of accuracy of the measurement information and the informationindicating the required accuracy.

(14)

An information processing apparatus including:

a control unit configured to perform processing with measurementinformation based on a result of detection by a sensor, and generateinformation indicating required accuracy of the measurement informationin accordance with details of the processing.

(15)

The information processing apparatus according to (14) described above,in which the control unit performs processing of superimposing anddisplaying a virtual object in real space, and generates the informationindicating the required accuracy in accordance with size of the virtualobject, superimposition distance, superimposition accuracy, andnecessity of occlusion processing.

(16)

An information processing method performed by a processor, including:

acquiring information indicating required accuracy of measurementinformation based on a result of detection by a sensor from anapplication that uses the measurement information; and controlling thesensor on the basis of the information indicating the required accuracy.

(17)

An information processing method performed by a processor, including:

performing processing with measurement information based on a result ofdetection by a sensor; and generating information indicating requiredaccuracy of the measurement information in accordance with details ofthe processing.

(18)

A recording medium including a program recorded, the program causing acomputer to function as

a control unit configured to acquire information indicating requiredaccuracy of measurement information based on a result of detection by asensor from an application that uses the measurement information, andcontrol the sensor on the basis of the information indicating therequired accuracy.

(19)

A recording medium including a program recorded, the program causing acomputer to function as

a control unit configured to perform processing with measurementinformation based on a result of detection by a sensor, and generateinformation indicating required accuracy of the measurement informationin accordance with details of the processing.

REFERENCE SIGNS LIST

-   10 Sensor group-   11 Inertial sensor-   12 Geomagnetic sensor-   13 GNSS receiver-   14 Camera-   20 Measurement unit-   21 Positioning unit-   22 Orientation measurement unit-   30 Sensor control unit-   40 Application-   100 Information processing apparatus, HMD-   111 Inward camera-   112 Outward camera-   121 Display unit

The invention claimed is:
 1. An information processing apparatus,comprising: a control unit configured to: acquire information indicatinga required accuracy of measurement information from an application thatuses the measurement information, wherein the information indicating therequired accuracy is acquired from the application based on sensorinformation from a sensor; and control the sensor based on theinformation indicating the required accuracy.
 2. The informationprocessing apparatus according to claim 1, wherein the control unit isfurther configured to control the sensor based on a power consumption ofthe sensor.
 3. The information processing apparatus according to claim2, wherein the control unit is further configured to control the sensorsuch that a sum total of the power consumption is minimized with therequired accuracy satisfied.
 4. The information processing apparatusaccording to claim 2, wherein the control unit is further configured tocontrol the sensor based on a remaining battery capacity associated withthe sensor.
 5. The information processing apparatus according to claim1, wherein the control unit is further configured to control at leastone of activation or stop of the sensor, an operation frequency of thesensor, or an accuracy of the sensor.
 6. The information processingapparatus according to claim 1, wherein the measurement informationincludes at least one of position information or orientationinformation.
 7. The information processing apparatus according to claim6, wherein the information indicating the required accuracy of themeasurement information includes at least one of a required accuracy ofabsolute position information, a required accuracy of absoluteorientation information, a required accuracy of relative positioninformation, or a required accuracy of relative orientation information.8. The information processing apparatus according to claim 1, whereinthe information indicating the required accuracy includes an indexcorresponding to the required accuracy.
 9. The information processingapparatus according to claim 1, wherein the information indicating therequired accuracy includes information indicating an availability of thesensor.
 10. The information processing apparatus according to claim 1,wherein the information indicating the required accuracy includesinformation indicating an intensity of an assumed motion of theinformation processing apparatus.
 11. The information processingapparatus according to claim 1, wherein the information indicating therequired accuracy includes information indicating an object as areference in measurement of relative measurement information.
 12. Theinformation processing apparatus according to claim 1, wherein in a casewhere measured position information corresponds to a preset specificgeographical range, the control unit is further configured to controlthe sensor based on the information indicating the required accuracycorresponding to the specific geographical range, and the measuredposition information is based on the sensor information.
 13. Theinformation processing apparatus according to claim 1, wherein thecontrol unit is further configured to control the sensor based on anaccuracy of the measurement information and the information indicatingthe required accuracy.
 14. An information processing apparatus,comprising: a control unit configured to: acquire measurementinformation based on sensor information output from a sensor; executespecific processing based on the measurement information; and generateinformation indicating a required accuracy of the measurementinformation based on the specific processing.
 15. The informationprocessing apparatus according to claim 14, wherein the control unit isfurther configured to: superimpose and display virtual object in realspace; and generate the information indicating the required accuracybased on size of the virtual object, a superimposition distancecorresponding to the virtual object, a superimposition accuracy, and anecessity of occlusion processing.
 16. An information processing methodperformed by a processor, comprising: acquiring information indicating arequired accuracy of measurement information from an application thatuses the measurement information, wherein the information indicating therequired accuracy is acquired from the application based on sensorinformation from a sensor; and controlling the sensor based on theinformation indicating the required accuracy.
 17. An informationprocessing method performed by a processor, comprising: acquiringmeasurement information based on sensor information output from asensor; executing specific processing based on the measurementinformation; and generating information indicating a required accuracyof the measurement information based on the specific processing.
 18. Anon-transitory computer-readable medium having stored thereoncomputer-executable instructions, which when executed by a processor,cause the processor to execute operations, the operations comprising:acquiring information indicating a required accuracy of measurementinformation from an application that uses the measurement information,wherein the information indicating the required accuracy is acquiredfrom the application based on sensor information from a sensor; andcontrol controlling the sensor based on the information indicating therequired accuracy.
 19. A non-transitory computer-readable medium havingstored thereon computer-executable instructions, which when executed bya processor, cause the processor to execute operations, the operationscomprising: acquiring measurement information based on sensorinformation output from a sensor; executing specific processing based onthe measurement information; and generating information indicating arequired accuracy of the measurement information based on the specificprocessing.